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Listing of the Claims : 

1 . (Previously presented) An apparatus for detecting objects in one or 
more images captured by an image pickup device mounted on a vehicle, comprising: 

(a) memory on which is stored pixels of at least one image captured by the 
image pickup device; and 

(b) a controller operatively coupled to the memory and adapted to compute 
velocity information for each pixel in an image using a sequential series of images; extract 
those pixels having a velocity component based on the velocity information, wherein the 
velocity component comprises a movement direction and a movement velocity in a lateral 
direction; define regions for detecting a road boundary; detect oblique lines based on 
grouping those extracted pixels having a velocity component in the regions; and generate a 
signal indicative of a road boundary in the image based on the oblique lines. 

2. (Previously presented) The apparatus of claim 1, wherein the controller 
is further adapted to judge that oblique lines in the image are road boundaries when the 
vehicle is traveling and the oblique lines are positioned on the image with bilateral symmetry 
and respectively comprise pixels having velocity components with different movement 
directions. 

3. (Previously presented) The apparatus of claim 1, wherein the controller 
is further adapted to judge that oblique lines in the image are road boundaries when 
respective slopes of the oblique lines decrease from a center of the image toward an outside 
of the image. 

4. (Previously presented) The apparatus of claim 1 , wherein the controller 
is further adapted to detect a change point where a velocity direction of a detected oblique 
line changes from one image to a subsequent image, and to judge that the change point as is a 
pitching balance point where a line of sight orientation of the image pickup device is 
horizontal with respect to a road surface. 
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5. (Previously presented) The apparatus of claim 1 , wherein the controller 
is further adapted to identify a moving object that is approaching a predicted path of the 
vehicle by grouping those extracted pixels having a same velocity component with the 
movement direction being from a side toward the predicted path of the vehicle; and to 
generate a collision danger signal indicative of a risk of collision between the vehicle and the 
moving object. 

6. (Previously presented) The apparatus of claim 5, wherein the controller 
is further adapted to transform into a real space road model the oblique lines judged as the 
road boundary and the moving object and to determine the risk of collision between the 
vehicle and the moving object based on a relative positional relationship between the road 
boundary and the moving object as established in the real space road model. 

7. (Original) The apparatus of claim 5, wherein the controller is further 
adapted to generate the collision danger signal at one of a plurality of values corresponding to 
collision risk levels. 

8. (Original) The apparatus of claim 5, further comprising an audio alert 
operatively coupled to the controller and activated by the collision danger signal. 

9. (Previously presented) The apparatus of claim 5 further comprising an 
automatic braking device operatively coupled to the controller and activated by the collision 
danger signal. 

10. (Previously presented) A vehicle, comprising: 

(a) a camera mounted including an image-pickup element generating as 
output a plurality of images; 

(b) memory on which is stored the plurality of images generated by the 
image pickup element; and 

(c) a controller operatively coupled to the memory and adapted to compute 
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velocity information for each pixel in an image using a sequential series of images; extract 
those pixels having a velocity component based on the velocity information, wherein the 
velocity component comprises a movement direction and a movement velocity in a lateral 
direction; define regions for detecting a road boundary; detect oblique lines based on 
grouping those extracted pixels having a velocity component in the regions; and generate a 
signal indicative of a road boundary in the image based on the oblique lines. 

1 1 . (Previously presented) The vehicle of claim 1 0, wherein the controller 
is further adapted to judge that oblique lines in the image are road boundaries when the 
vehicle is traveling and the oblique lines are positioned on the image with bilateral symmetry 
and respectively comprise pixels having velocity components with different movement 
directions. 

12. (Previously presented) The vehicle of claim 10, wherein the controller 
is further adapted to judge that oblique lines in the image are road boundaries when 
respective slopes of the oblique lines decrease from a center of the image toward an outside 
of the image. 

13. (Previously presented) The vehicle of claim 10, wherein the controller 
is further adapted to detect a change point where a velocity direction of a detected oblique 
line changes from one image to a subsequent image, and to judge that the change point is a 
pitching balance point where a line of sight orientation of the camera is horizontal with 
respect to a road surface. 

1 4. (Previously presented) The vehicle of claim 1 0, wherein the controller 
is further adapted to identify a moving object that is approaching a predicted path of the 
vehicle by grouping those extracted pixels having a same velocity component with the 
movement direction being from a side toward the predicted path of the vehicle; and to 
generate a collision danger signal indicative of a risk of collision between the vehicle and the 
moving object. 
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1 5 . (Previously presented) The vehicle of claim 1 4, wherein the controller 
is further adapted to transform into a real space road model the oblique lines judged as the 
road boundaiy and the moving object, and to determine the risk of collision between the 
vehicle and the moving object based on a relative positional relationship between the road 
boundary and the moving object as established in the real space road model. 

1 6. (Original) The vehicle of claim 14, wherein the controller is further 
adapted to generate the collision danger signal at one of a plurality of values corresponding to 
collision risk levels. 



17. (Original) The vehicle of claim 14, further comprising an audio alert 
operatively coupled to the controller and activated by the collision danger signal. 



18. (Previously presented) The vehicle of claim 1 4, further comprising an 
automatic braking device operatively coupled to the controller and activated by the collision 
danger signal. 



19. (Previously presented) An apparatus for detecting objects in one or 
more images captured by an image pickup device mounted on a vehicle and traveling on a 
road, comprising: 

(a) velocity information computing means for processing a sequential 
series of images to compute velocity information for each pixel in an image; 

(b) pixel extracting means for extracting pixels having a velocity 
component based on the velocity information computed by the velocity information 
computing means, wherein the velocity component comprises a movement direction and a 
movement velocity in a lateral direction; 

(c) defining means for defining regions for detecting a road boundary; 

(d) oblique line detecting means for detecting oblique lines made of pixels 
having a velocity component and extracted by the pixel extracting means by grouping those 
extracted pixels having the velocity component in the regions; and 
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(e) boundary line detecting means for detecting at least one boundary line 

on the road present in the image on the basis of the oblique line detected by the oblique line 

detecting means. 

20. (Previously presented) The apparatus of claim 1 9, wherein the 
boundary line detecting means judges that the oblique lines are road boundaries when the 
vehicle is traveling and the oblique lines detected by the oblique line detecting means are 
positioned with bilateral symmetry on the images and respectively comprise pixels having 
velocity components with different movement directions. 

2 1 . (Previously presented) The apparatus of claim 1 9, wherein when 
multiple oblique lines are detected by the oblique line detecting means, the boundary line 
detecting means detects the oblique lines as boundary lines on the road when respective 
slopes of the oblique lines decrease from a center of the image in front of the vehicle toward 
an outside of the image. 

22. (Previously presented) The apparatus of claim 1 9, further comprising 
balance point judgment means for detecting a change point where a velocity direction of a 
detected oblique line detected by the oblique line detecting means changes from one image to 
a subsequent image, and judging that the change point is a pitching balance point where a line 
of sight orientation of the image pickup device is horizontal with respect to a road surface. 

23 . (Previously presented) The apparatus of claim 22, further comprising: 
object detecting means for grouping those pixels extracted by the pixel 

extracting means having a same velocity component with the movement direction being from 
a side toward a predicted movement path of the vehicle, and detecting moving objects that 
approach the predicted movement path of the vehicle; 

transformation means for transforming the oblique lines judged as the 
boundary lines on the road by the boundary line detecting means and the moving object 
detected by the object detecting means into a real space road model; and 
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degree of collision danger judgment means for accessing a degree of collision 
danger between the vehicle and the moving body on the basis of a relative positional 
relationship between the boundary lines on the road together with the moving object 
established in the real space road model by the transformation means. 

24. (Previously presented) The apparatus of claim 23, wherein: 
the degree of collision danger judgment means classifies the degree of 

collision danger between the vehicle and the moving object into multiple risk levels and 
makes a judgment according to a degree of risk based on the multiple risk levels; and 

further comprising risk avoidance means for controlling the vehicle to avoid a 
collision between the vehicle and the moving object according to the degree of risk assessed 
by the degree of collision danger judgment means. 

25. (Previously presented) A method for detecting objects in an image 
captured of the pathway of a vehicle, comprising: 

(a) computing velocity information for each pixel in the image using a 
sequential series of images; 

(b) extracting from the image those pixels having a velocity component 
based on the velocity information, wherein the velocity component comprises a movement 
direction and a movement velocity in a lateral direction; 

(c) defining regions for detecting a road boundary; 

(d) detecting oblique lines by grouping extracted pixels having a velocity 
component in the regions; and 

(e) detecting one or more boundaiy lines on the vehicle pathway in the 
image from the oblique lines. 

26. (Previously presented) The method of claim 25, wherein detecting one 
or more boundary lines comprises judging that the oblique lines are road boundaries when the 
vehicle is traveling and the oblique lines are positioned with bilateral symmetry on the 
images and each oblique line comprises pixels having velocity components with a movement 
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direction different from a movement direction of pixels of the other oblique line. 

27. (Previously presented) The method of claim 25, wherein multiple 
oblique lines are detected as the boundary lines on the vehicle pathway when respective 
slopes of the oblique lines decrease from a center of the image in front of the vehicle toward 
an outside of the image. 

28. (Previously presented) The method of claim 25, further comprising: 
detecting a change point where a velocity direction of an oblique line detected 

by the oblique line detecting means changes from one image to a subsequent image, and 
judging that the change point is a pitching balance point where a line of sight orientation of 
an image pickup device is horizontal with respect to a road surface. 

29. (Previously presented) The method of claim 25, further comprising: 
grouping the pixels having movement directions from a side toward a 

predicted movement path of the vehicle from among the extracted pixels, and detecting a 
moving object that approaches the predicted movement path ahead of the vehicle where a 
group of pixels has a same velocity component; 

transforming into a real space road model the oblique lines judged as the 
boundary lines on the road and the moving object; and 

accessing a degree of collision danger between the vehicle and the moving 
object on the basis of a relative positional relationship between the boundary lines on the road 
and the moving object established in the real space road model. 

3 0 . (Previously presented) The method of claim 29, further comprising : 
classifying the degree of collision danger between the vehicle and the moving 

object into one of a plurality of risk levels and making a collision danger judgment according 

to the classified degree; and 

generating a signal to control the vehicle to avoid a collision between the 

vehicle and the moving object according to the collision danger judgment. 



